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METHOD FOR RECOVERING, COMPRESSED MOTION PICTURE 
FOR ELIMINATING BLOCKING ARTIFACTS AND RING EFFECTS 
AND APPARATUS THEREFOR 

BACKGROUND OF THE INVENTION 

1. Field of the invention 

The present invention relates to an image processing technique, and 
in particular to a method for recovering a compressed video signal and 
an apparatus therefor. 

2. Description of the prior art 

The image compression technique of MPEG, MPEG2, H261, H263, 
etc. is implemented by a Hybrid MC DCT(Motion Compensation Discrete 
Cosine Transform) technique. This hybrid MC DCT is classified into an 
encoding process and decoding processes. In the encoding process, the 
original image is divided into a plurality of blocks for compressing the 
information of a spacious region, and a two-dimensional DCT is 
performed with respect to each block, and a redundancy is decreased in 
the image or between the images using a correlation on a time axis 
between the images for decreasing the information of the time region. In 

- 1 - 



addition, in the decoding process, the reverse sequence of the decoding 
process is performed. In order to implement the MCDCT technique, an 
encoder and decoder are required. 

Figure 1 is a block diagram illustrating a conventional image 
encoder. As shown therein, an input video signal is subtracted by a 
subtractor 1 with a motion compensated video signal from a video 
memory 9 and is inputted via a first switching unit 2 and a DCT unit 3. 
The DCT unit 3 processes the inputted video signal based on a DCT, 
and a quantization unit 4 quantizes a DCT-processed video signal and 
outputs a DCT coefficient q. This coefficient is reversely quantized by a 
reverse quantizing unit 6 and is processed based on a reverse DCT by a 
reverse DCT unit 7 for thereby recovering the original video signal. The 
thusly recovered video signal is summed by a summing unit 8 with a 
video signal recovered in the earlier process via a second switching unit 
10 and is inputted into the video memory. A controller 5 controls the first 
and second switching units 2 and 10 and transmits an intra/inter 
information(p=mtype; flag for INTR A/lNTER ) , a transmission information 
(q; flag for transmitted or not), and an quantizing information (qz=Qp; 
quantizer indication) to a decoder (not shown in Figure 1). The video 
memory 9 outputs a motion vector information(v=MV; motion vector) to 
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the decoder. The DCT unit 3 outputs a DCT coefficient q to the decoder. 

While the video signal is being coded, the information may be lost 
during the quantizing process. Therefore, the video signals reconstructed 
by the decoder may cause blocking artifacts and ring effects. The block 
artifacts occur when quantizing a low frequency DCT coefficient, and the 
ring effects occur due to the information loss of the original video in the 
quantizing process for a high frequency DCT coefficient. 

Namely, in the case of the coding technique using a DCT in a 
system which is capable of coding a still picture or a motion picture, the 
entire image is divided into a plurality of small images (for example, 8x8 
blocks), and then a transforming operation is performed with respect to 
the divided blocks, and the original image is processed based on a DCT, 
and an important information of the original image based on a result of 
the conversion is included in the low frequency component. As the 
component becomes high frequency, the important information is 
decreased. The low frequency component includes an information related 
to the neighboring block. The DCT transform is performed without 
considering a corelation between the blocks. Namely, the low frequency 
components are quantized by the blocks, so that a continuity between the 
neighboring blocks is lost. This phenomenon is called as the blocking 
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artifacts. 

In addition, when quantizing the coefficients obtained when 
performing the DCT operation, as the interval of the quantizing operation 
is increased, the components to be coded is decreased. Therefore, the 
number of bits which will be processed is decreased, so that a distortion 
occurs in the reconstructed original image. This phenomenon is called as 
the ring effects. The ring effects which occur when increasing the 
intervals of the quantizing operations are increased at a contour line of 
an object among the images* 

As a technique for removing the above-described block artifacts and 
ring effects, a low pass filter technique and a regularization recovering 
technique are generally used. 

The low pass filter experiencially sets a filter tap or a filter 
coefficient based on or by selecting (filter mask) a plurality of pixels near 
a certain pixel and obtaining an average of the pixels. The recovered 
images are over smoothed in accordance with the kinds of images, and a 
compression ratio. 

In the regularization recovering method, the block artifacts are 
adaptively processed in accordance with the statistical characteristic of 
the images. Namely, a non -uniform information is all computed at all 
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direction boundary areas- and in the interior of the block. However, since 
the computed values have a matrix form, it is impossible to implement a 
real time computation due to a large amount of computation. In addition, 
with an exception for the amount of non-uniformity, since an average is 
comprehensively adapted based on a result of the computation of the 
non -uniform information, in the block having a large amount of 
non-uniformity, the degree of the non-uniformity is decreased. On the 
contrary, the degree of the non -uniformity may be increased. Therefore, 
it is hard to say it is well adaptive to the system. 

The above-described two techniques have advantages and 
disadvantages in view of a complexity and performance increase of the 
system. Namely, the low pass filter technique has less computation 
amount compared to the regularization recovering technique and has a 
small capacity for adaptively processing the images, so that the 
information is lost at an edge portion. The regularization recovering 
method has an excellent performance and requires a large amount of 
computation when computing regularization parameters. 



SUMMARY OF THE INVENTION 

Accordingly, in the present invention, it is possible to removing a 
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block artifact and ring effect which occur in a decoded video signal, ^ 

In addition, it is possible to define a cost function having a 
directional feature by the unit of pixels during a decoding operation and 
obtain a regularization parameter based on the cost function. 

To achieve the above objects, there is provided a method for 
recovering a compressed motion picture, comprising the steps of defining 
a cost function having a smoothing degree of an image and a reliability 
with respect to an original image in consideration of the directional 
characteristics of the pixels which will be recovered and a plurality of 
pixels near the recovering pixels, obtaining a regularization parameter 
variable having a weight value of a reliability with respect to an original 
image based on the cost function, and approximating the regularization 
parameter variable using the compressed pixel and obtaining a recovering 
pixel. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram illustrating a conventional video encoder; 
Figure 2 is a block diagram illustrating an apparatus for recovering a 
compressed motion picture according to the present invention; 

Figure 3 is a view illustrating pixels and a position information of 
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the pixels for explaining the operation of the present invention; 

Figure 4 is a flow chart of a method for recovering a compressed 
motion picture according to an embodiment of the present invention! and 

Figure 5 is a flow chart of a method for recovering a compressed 
motion picture according to another embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Figure 2 is a block diagram illustrating an apparatus for recovering a 
compressed motion picture according to the present invention. As shown 
therein, a decoder 201 receives an intra/inter information(p=mtype), a 
transmission information (t), a quantizing information(qz=Qp), a DCT 
coefficient q, and a motion vector information(v=MV; motion vector) from 
an encoder as shown in Figure 1 and decodes the thusly received 
information. The encoder and decoder 201 are connected by a 
communication channel or network. A block removing filter 202 receives 
a video signal(Y,U,V), a quantizing variable (qz^Qp), a macro block 
type(mtype), and a motion vector(v-MV) from the decoder 201 and 
performs an image compressing process according to the present 
invention for thereby outputting a recovered video signal. 

Figure 3 illustrates pixels and the position of the pixels for 
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explaining the operation of the present invention. As shown therein, 
assuming the original pixels f(ij) at the center portion as a reference, 
f(ij-l) represents a pixel near the left side, and f(i,j + l) represents a pixel 
near the right side, and f(i-lj) represents a pixel near the upper side, 
and f(i+lj) represents a pixel near the lower side. Here, i, j represent a 
position information of each pixel. 

A first embodiment of the present invention will be explained with 
reference to the accompanying drawings. 

In the embodiment of the present invention, a cost function having a 
directional feature by the unit of pixels is defined, and a regularization 
parameter is obtained based on the cost function, and a recoverable pixel 
is obtained using a value which is actually adapted to the regularization 
parameter and is processed based on a DCT and a projection, and then a 
resultant data is processed based on a reverse DCT for thereby 
recovering an image similar to the original image. The above-described 
operation will be explained in detail. 

[Definition of cost function] 

When the original image f is compressed and transmitted, the image 
g which is reconstructed by the decoder 201 may be expressed as 
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follows. 

g = f + n (1) 

where, g, f, and n have a size of MMxl rearranged in a scanning 
sequence, and n represents a quantizing difference. 

In order to process the original image f by the unit of pixels, the 
original pixels f(ij) having a certain position information (ij) is adapted. 
The recovered pixel g(ij) may be expressed using the original pixel(ij) 
and a quantizing difference n(i,j) with respect to the original pixel(ij). 

g(ij) = f(ij) + n(ij) (2) 

As seen Equation 2, a smoothing which represents a non -uniformity 
degree with respect to the original pixel f(ij) and the neighboring pixels 
of the original pixel f(i,j) and a cost function including a reliability with 
respect to the original pixel f (ij) and the compressed pixel g(ijX 

First, in order to consider the directional features of four pixels 
f(ij+l), f(i+l,j), f (ij— 1), and f(i-lj) with respect to the original pixel f(ij), 
the cost functions of MHL(f(ij>), MimCfttj)), Mvr(f(ij)), MvottCij)), 
Mr(f(ij)) are defined with respect to the neighboring pixels. In order to 
set a time based region relationship of the original pixel f(ij), the cost 
function MT(f(i,j)) is defined. Next, the cost functions of MmXfCij)), 
M H R(f(ij)\ MvT(f(ij)), MvD(f(ij)), M T (f(ij)) with respect to the 
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neighboring pixels and the cost function M-HfGj)) of the time region are 
summed, so that it is possible to obtain the cost function M(f(ij)) with 
respect to the original pixel f(ij) may be obtained based on Equation (3). 
M(f(ij)) = MraXfGj)) + MHR(fttj)) + Mvx(f(iJ)) + MvD(f(y)) — (3) 
+ MrCfGj)) 

where Mhl represents a cost function having a relationship between 
the pixel f(ij) and the left side neighboring pixel f(ij-l), MHR(f(i,j)) 
represents a cost function having a relationship between the pixel f(ij) 
and the right side neighboring pixel f(ij+l), Mvr(f(ij)) represents a cost 
function having a relationship between the pixel f(ij) and the upper side 
neighboring pixel f(i-lj), Mvo(f(ij)) represents a cost function having a 
relationship between the pixel f(ij) and the lower side neighboring pixel 
f(i+lj), and M-r(f(ij)) represents a cost function having a relationship of 
the time region. 

The cost function having a smoothing degree and reliability may be 
expressed as the following equation 4 



MHL(fGj)) 


= C f(U) 


- f(ij-l) f + 


a hl 


[ g(ij)-f(ij) f 


MHR(fGj)) 


= [ fGJ) 


- f(U+l) ] 2 + 


am 


[ g(i,j)-f(i,j) f 


Mvr(f(ij)) 


= [ fOi) 


- f(i-lj) ] 2 + 


a vt 


[ g(ij)-f(ij) f 


MvD(f(ij» 


= [ f(ij) 


- f(i+lj) f + 


a vd 


[ g(i,j)-f(i,j) f 
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M T (f(ij)) = [ f(i,j) - fMc(ij) f + ari g(ij)-f(ij) f 
As seen in Equation 4, the first term of the right side of each cost 
function represents a smoothing degree with respect to the original pixel 
and the neighboring pixel, and the second term of the right side 
represents a reliability with respect to the original pixel and the recovered 
pixel. 

The first term of the right side of the cost function MHL(f(ij)) 
represents a square value of the difference between the original pixel 
f(i,j) and the left side neighboring pixel f(ij-l) and represents a 
uniformity degree, namely, a smoothed degree of the original pixel f(ij) 
and the left side neighboring pixel f(ij-l) based on the error component 
between the original pixel f(ij) and the left side neighboring pixel f(ij-l). 
In addition, the second term of the right side of the cost function 
MfflXfCij)) represents a square value of the difference between the 
original pixel f(i,j) and the compressed pixel g(ij) and represents a value 
for comparing whether a certain difference exists between the compressed 
pixel g(ij) and the original pixel f(ij) based on a difference component 
between the original pixel f(i,j) and the compressed pixel g(ij) and 
represents a reliability of the original pixel f(ij) and the compressed pixel 
g(ij). 
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In addition, the first term of the right side of Mim(f(ij)) represents a 
smoothing degree of the original pixel f(ij) and the right side neighboring 
pixel f(ij + l), and the second term of the right side represents a reliability 
of the original pixel f(i,j) and the compressed pixel g(ij). The first term 
of the right side of the cost function Mvr(f(i,j)) represents a smoothing 
degree of the original pixel f(ij) and the upper side neighboring pixel 
f(i-lj), and the second term of the right side represents a reliability of 
the original pixel, and the compressed pixel g(ij). The first term of the 
right side of the cost function Mvr(f(ij)) represents a smoothing degree 
of the original pixel f(i,j) and the lower side neighboring pixel f(i + lj), 
and the second term of the right side represents a reliability of the 
original pixel f(i,j) and the compressed pixel g(ij). M-rCfCij)) represents a 
cost function for setting a relationship of the time region. 

The values of a el , am ,avr , <2vd of the second term of the 
right side represents a regularization parameter and a ratio of a 
smoothing degree and reliability. These values represent a difference 
component. In addition, these values represent a weight value with 
respect to the reliability. As these values are increased, the reliability is 
enhanced. Since the smoothing degree and the reliability are opposite to 
each other, the ratio of the smoothing degree and reliability is determined 
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when the regularization parameter is determined. Each regularization 
parameter may be expressed as the following Equation 5. 

a _ \f(iJ)-f(i,j-l)] 2 ~ = \f(iJ)~f(iJ+l\] 2 



LAiJ)-fMcUJ)l 2 

In the above Equation 5, the denominators of the above-equations 
represents a difference between the original pixel and the compressed 
pixel, and the numerator represents a difference between the original pixel 
and the neighboring pixel. 



Computation of recovering pixels based on cost function 

It is needed to obtain the recovering pixels which is the original 
pixels. However, the cost function includes a square with respect to the 
original pixel. Therefore, the cost function is partially differentiated with 
respect to the original pixel, so that it is possible to obtain the original 
pixels based on the differentiated values. The cost function M(f(i,j)) may 
be differentiated based on Equation 3. 
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(Ai.ft) dM HL {AiJ)) , BM HR (AU )) , dM VT (AiJ)) 



dMyniAiJ)) | dMMUi)) = Q 



Each term of the right side of the cost function with respect to the 
neighboring pixels is as follows. 

dM HL (AiJ)) 



dAiJ) 

dAiJ) 



= 2 [ f(i,j) - fGj-l) ] - 2othl [g(ij)-f(ij)3 



=2 [ f(i,j) - fGJ+1) ] - 2am [g(ij)-f(i,j)] (7) 



dM dA?jj j)) = 2 [ f(i ' j) " f(i " lj " > 1 ~ 2 * VT k^"*^ 



dMvdAi,j» = 2 c f( . j} _ fG+lj) 3 _ 2 ^ vd [g(iJ) _ f(i>j)] 



dAiJ) 
dM T (AiJ)) 



= 2 [ f(i,j) - f M c(i,j) ] - 2ar [g(ij)-f(i,j)] 



BAiJ) 

The values of Equation 7 are substituted for Equation 6, and the 
pixels which will be finally recovered are in the following Equation 8. 
. AiJ-D + AiJ+l) + fU-l.J) + Ai+l,j) + fMcdf) + aroTSiiJ) 

At, J) = c i „ 

D T a tot (g) 
a TOT ~ <*HL + & VT + <*VD + &T 

The pixels expressed by Equation 8 are the pixels included in the 
inter macro block. However, the pixels of the macro block coded into the 

intra macro type based on Equation 6 is dAi j)^ ~® ^ ecause there 
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is not a motion information on the time axis. Therefore, the pixels 
included in the intra macro block may be expressed in the following 
Equation 9. 

, AiJ-1) + AiJ+D + Ai-l,f) + Ai+U) + aroTgHJ) 
Auj) ~ 4 + a TOT 

a TO T = &HL + a VT + &VD 

( 9 ) 

Therefore, the pixels included in the inter macro block are obtained 
based on Equation 8, and the pixels included in the intra macro block are 
obtained based on Equation 9. Whether the pixels of the macro block are 
coded in the intra macro type or in the inter macro type are determined 
by the intra inter informationCp^mtypeX 

As seen in Equations 8 and 9, the recovering pixels include a 
regularization parameter a, and each regularization parameter variable is 
approximated as follows. 



Approximation of regularization parameter variable 

As seen in Equation 5, each regularization parameter variable 
includes an original pixel, a neighboring pixel, and a recovering 
pixeKcompressed pixel). In addition, since the original pixel f(ij) and four 
neighboring pixels f(ij-l), f(ij + l), f(i-lj), f (i^l J) are the original pixels, 
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these values do net exist in the decoder. Therefore, the pixels f(ij), 
f(ij-l), f(i,j+D, f(i-lj), f(i+lj) may not be used for an actual 
computation. Therefore, in order to actually use the pixels f(i,j), f(ij-l), 
f(ij+l), f(i-lj), f(i + lj), the compressed pixels g(i,j), g(ij-l), g(ij+l), 
g(i-lj), g(i + lj) must be approximated. To implement the above-described 
approximation, the following three cases are assumed. 

First, the quantizing maximum difference of the macro block unit is 
a quantizing variable(Qp), 

Second, a quantizing difference of each DCT coefficient is uniformly 
allocated to each pixel of a corresponding macro block, 

Third, the non-uniform values between two pixels of the original 
pixel are statistically similar to the non-uniform values between two 
pixels of the compressed image. 

As seen in the following Equation 25, each regularization variable is 
approximated based on the above-described three cases. 



[g(i,j)-Ai.M 2 ' Q% 



a VT 



[g{iJ)-AiJ)? ' Q\i 



(10) 
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avD " lg(i.J)-MJ)] 2 ' <& 

[AiJ)-fMcU,j)] 2 ._ [g<^y)-/Mc(?,;)] 2 

where / represents the /-th macro block, and Qp/ represents a 
quantizing variable of the /-th macro block. As seen in Equation 10, the 
difference between the original pixel which is the denominator component 
of each regularization parameter variable and the compressed pixel is 
approximated based on the quantizing maximum difference, and the 
difference between the original pixel which is the numerator component 
and the compressed pixel is approximated based on the difference with 
respect to the difference value between the compressed pixel and the 
neighboring pixel 

The thusly approximated regularization parameter variable is 
substituted for Equation 8 or 9 for thereby obtaining a result value f(i,j). 

Figure 4 is a flow chart illustrating a method for recovering a 
compressed motion picture according to the present invention. 

As shown therein, in Step ST1, whether the processing pixels are 
referred to the pixels of the intra macro block or the pixels of the inter 
macro block is judged. As a result of the judgement, in Steps ST2 and 
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ST3, the regularization parameter variable is obtained. Namely, if the 
processing pixels are referred the pixels of to the intra macro block, in 
Step ST2, the regularization parameter variables c?hl , #hr ,#vx , tfvDar 
are obtained based on Equation 9. In addition, if the processing pixels are 
referred to the pixels of the inter macro block, the regularization 
parameter variables #hl , c^hr ,^vt ,^vd are obtained in Step ST3. 
In addition, the pixel f(ij) is obtained in Step ST4 based on the obtained 
regularization parameter variable. At this time, if the processing pixels 
are referred to the pixels of the inter macro block, and the pixels are 
obtained based on Equation 8, and if the processing pixels are referred to 
the pixels of the inter macro block, the pixels are obtained based on 
Equation 9. 

Recovering the images using a projection technique 

In Step ST5°11, a DCT is performed with respect to the pixel f(ij), 
and then a quantizing process is performed therefor. Here, the DCT 
coefficient of the pixel f(i,j) may be expressed as F(u,v). 

The value G(u,v) which is DCT-processed with respect to the 
compressed image g(i,j) may be expressed in the DCT region based on 
the following Equation 11. 

- 18 - 



G - QBf - (ID 

where B represents a DCT process, and Q represents a quantizing 
process. 

The DCT coefficient of the original image and the DCT coefficient of 
the compressed image have the following interrelationship as seen in 
Equation 12. 

GKu,v) - Qpl ^ F(u,v) ^ G(u,v) + Qpl (12) 

where G(u,v) represents a (u,v)-th value of the two-dimensional 
DCT coefficient of the compressed image, F(u,v) represents a (u,v)-fh 
value of the two-dimensional DCT coefficient of the original image, Qpl 
represents the quantizing maximum difference of the hth macro block, 
and each DCT coefficient value represents a subset for setting the range 
of the DCT coefficient of the recovered images. Therefore, the recovered 
images must be projected based on the subset of Equation 12, and this 
process is performed in Step ST6 as seen in the following Equation 13. 
P(F(u,v)) = G(u f v) - Qpl if F(u,v) < G(u,v) - Qpl 

P(F(u,v)) = G(u,v) + Qpl if F(u,v) > G(u,v) + Qpl (13) 

P(F(u,v)) = F(u,v) otherwise 
The Equation 13 will be explained in detail 

If FCu,v) is smaller than G(u,v) - Qp/, the projected recovering image 
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P(F(u/v)) is mapped based on G(u,v) - Qp/, and if F(u,v) is larger than 
G(u,v) - Qp/, the projected recovering image P(F(u,v)) is mapped based 
on G(u,v) + Qp/, otherwise P(F(u,v)) is directly mapped based on the 
projected recovering image F(u,v). 

The mapped image P(F(u,v)) is reversely DCT-processed in the 
spacious region in Step ST7, and the finally recovered image may be 
expressed by the following Equation 14. 

f = B T PB J = B T PBK(g) (14) 

where K(g) represents a computation of the recovering pixels of 
Equation 8 or 9, BK(g) represents a block DCT coefficient, PBK(g) 
represents a projected block DCT coefficient, and B T PBK(g) represents 
that the projected block DCT coefficient is recovered in the spacious 
region. The recovered image is stored in the image memory and is 
outputted. 

In the present invention, it is possible to eliminate a block artifact 
and ring effect based on an non-uniform degree and reliability of the 
recovered image using a plurality of information from the decoder. 

Repetition technique 

If the block artifact and ring effect are not fully eliminated from the 
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recovered pixels, the above- described processes may be repeatedly 
performed. As the process for eliminating the block artifact and ring 
effect is repeatedly performed, the block artifact and ring effect of the 
recovering image is more eliminated. In this case, a blurring phenomenon 
occurs in the edge region of the image. Therefore, the number of 
repetition must be determined based on the block artifact and ring effect 
and the blurring phenomenon which is opposite thereto. 

The recovering image f k+x {ij) is as follows based on Equations 15 
and 16 by repeating the above-described process by k-times. 

. , . . _ fk(iJ-D +fk(iJ+D +fk(i-hj)+fkU+hi) +fMcUJ) +ak,TOTg(iJ) 
fk ^ j) ~ 5 + a ktT0T 

= &k,HL + + @k t VD + &k,T 
(15) 



, , . -v fkUJ-l) +fk(hJ+D +fk(i~U) + /*(*+!,/) + ctk.TOTg(iJ) 

4 -r otk,TOT 

&k,TOT — &k.HL + Qk,HR+ &k,VT + &k.VD 

(16) 

The image expressed based on Equation 15 is related to the pixels 
included in the inter macro block, and the image expressed based on 
Equation 16 is related to the pixels included in the intra macro block. 

The regularization parameter variables are obtained based on 
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Equations 15 and 16, and the DCT is performed with respect" 'thereto, and 
the projection technique is adapted, and then the reverse DCT is 
performed therefor, so that the final recovering image is obtained based 
on Equation 17. 

fa/ = B T PB 9 = B T PBK(g k ,D (17) 

Namely, the block artifacts and ring effects are eliminated from the 
recovered images by an adaptive decoding operation, so that a real time 
process is implemented in the digital video apparatus. In particular, it is 
possible to enhance the resolution in the compression images which 
require a low bit ration or high speed process. 

Next, another embodiment of the present invention will be explained. 

This embodiment of the present invention is basically directed to 
decreasing the computation amount and time compared to the earlier 
embodiment of the present invention. The operation thereof is performed 
by the recovering apparatus, as shown in Figure 2, of the compression 
motion picture according to the present invention. First, the cost function 
may be defined as seen in Equation 18. 

M(f(i,j)) = M L (f(i,j)) + M R (f(ij)) + Mu(f(ij» + MnCfCij)) (18) 

where Ml represents a cost function having an interrelationship 
between the pixel f(ij) and the left side neighboring pixel f(ij-l), 
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MR(f(i,j)) represents a cost function having an interrelationship between 
the pixel f(i,j) and the right side neighboring pixel f(i,j + l), Mu(f(i,j)) 
represents a cost function having an interrelationship between the pixel 
f(i,j) and the upper side neighboring pixel f(i-lj), and MD(f(ij)) is a cost 
function having an interrelationship between the pixel f(ij) and the lower 
side neighboring pixel f(i+lj). 

Next, the cost functions including a smoothing degree and reliability 
are defined. The regularization parameter variable is included in only the 
portion (the second term of the right side in Equation 4) of the reliability 
with respect to the original pixel and recovered pixel Differently from 
this construction, in another embodiment of the present invention, the 
regularization parameter variable is included in the portion which 
represents a reliability of the original pixel and recovered pixel as well as 
is included in the portion which represents the smoothing degree with 
respect to the original pixel and the neighboring pixel. In addition, the 
smoothing degree and the reliability of the pixel are opposite each other 
inn their meaning. Each cost function may be expressed based on 
Equation 19. 

ML(fGj)) = ff L (f(ij))[f(ij) " f(U-l)] 2 + (l-a L (f(ij)))[g(i,j)-f(iJ)] 2 
M R (f(ij)) = a R (f(ij))[f(ij) - f(ij+l)] 2 + (1- ffR(f(ij)))[g(ij)-f(ij)] 2 
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Mu(fGj)) = ffu(f(ij))[f(ij) " f(i-U)] 2 + (l-au(f(ij)))[g(U')-f(ij)] 2 — (19) 
M D (f(i,j)> = a D (f(iJ))[f(ij) - f(i-^lj)] 2 + (1- ^ o(f (i j)))[g(ij)-f 

As seen in Equation 19, the first term of the right side represents a 
smoothing degree with respect to the original pixel and the neighboring 
pixel, and the second term of the right side represents a reliability with 
respect to the original pixel and the recovered pixel. Here, au #R> <?u , 
ct d represent a regularization parameter variable with respect to each 
cost function and represent a ratio of a smoothing degree and reliability 
as a difference component. For example, <?l represents a weight value 
with respect to the smoothing degree, and 1-#l represents a weight 
value with respect to the reliability. Therefore, as the regularization 
parameter variable is increased, the smoothing degree is increased, and 
the reliability is decreased. Since the regularization includes the right side 
first term and the left side term of the cost function, it is possible to 
implement more stable smoothing degree and reliability compared to the 
earlier embodiment of the present invention. 

Next, in order to obtain the recovering pixel, the cost function is 
partially differentiated with respect to the original pixel. The thusly 
differentiated value is obtained by the following Equation 20. 
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( AiJ)) dMMiJ)) , dM R (Ki,j)) , dMMiJ)) , 

m "m,j) " <?/(*,;) + " r + (20) 



dM D (Ai,D) = Q 



The terms of the right side of Equation 20 are as follows: 
^/(f i)^ =2g L (f(y))[f(ij)-f(ij-l)]-2(l-g L (f(i > j)))[g(i > j)-f(i > j)3 



dM R (At,j)) =2 aR (f(ij))[f(ij)-f(ij + i)]-2(l- ff R (f(ij)))[gGj)-f(ij)] 



dKiJ) 

3M ^)) )) = 2 ff u(f(i,j))[f(i,j)-f(i-lj)]-2(l- « u(f(ij)))[g(i,j)-f(ij)] — (21) 

^fU^ =2 «D(f(ij))[f(iJ)-f(M j)]-2(l- a D (fGj)))b(ij)-f(ij)] 

When the values expressed based on Equation 21 are substituted for 
Equation 20, the finally recovered pixels are obtained based on the 
following Equation 22. 

a . , aiA i, J-D + i, J+ 1) + aiA i- 1 . /) + apA t+ 1 , J) + (4 - arorM i. J) 
At,n = 1 

a TO r = a L + a R + a v + a D 
(22) 

In addition, in the macro type(mtype), the bit value which is 
defined as COD is included. This COD includes an information of the 
macro block. If COD value is '0', it means the coded macro block, and if 
COD value is '1', it means the non-coded macro block(not coded). 
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Namely, it is possible to recognize whether the" pixels of the current 
macro block are the same as the pixels of the previously transmitted 
macro block. If COD value is 4 0\ it means that the macro block of the 
previous compressed image is different from the macro block of the 
current image, and if COD value is T, it means that the macro block of 
the previous image is the same as the macro block of the current image. 
Therefore, if COD value is '0', the value is recovered based on Equation 
22, and if COD value is '1', as seen in Equation 23, the recovered pixel 
value fp(ij) is substituted for the current pixel value with respect to the 
macro block of the previous image. 

f(i,j) = fp(i,j) (23) 

Next, as seen in Equation 22, the recovering pixel includes a 
regularization parameter variable a , and each regularization parameter 
variable is obtained as follows. 

'The regularization parameter variable is obtained based on Equation 
19. Namely, since the smoothing degree and reliability are opposite to 
each other, the regularization parameter variable may be arranged as 
follows based on a ratio of the smoothing degree and the reliability. 
Equation 24 may be expressed as follows. 
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= \Ki.i)-f(iJ-m 2 

Vr lAiJ)-g(iJ)? 
l-<*v = \KLft-Ai-l.h'\ 2 (24) 

In order to obtain the regularization parameter variable expressed as 
Equation 24, the pixels f(i,j), f(ij-l), f(ij + l), f(i-lj), f(i + lj) must be 
approximated based on the compressed pixels g(ij), g(ij-l), g(ij+l), 
g(i-l j), g(i+l,j) which may be actually used. For implementing the 
above-described operation, the following three cases are assumed. 

First, a quantization difference of each pixel is a function of a 
quantization variable Qp which is set by the unit of macro blocks. 

Second, since the block artifacts generating at a block boundary has 
a certain non-uniformity degree which is larger than the ring effect 
occurring in the interior of the block, the difference with respect to the 
pixels positioned at the block boundary is more largely reflected compared 
to the pixels positioned in the interior of the block. Namely, a weight 
value is provided to the difference based on the position of the pixels. 
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Equation 24 is approximated to Equation 25 based on the 
above-described two assumptions, 

_ \Kub-Ki-l.ii\* ^ \s(i.i)-*(i-l.M 2 (2Fi) 

i-^ = \ALi)-Ki+i.m 2 \z(ij)-z(i+i.m 2 

a D iAiJ)-g(t,M 2 * ®W 

where &(Qi>) is a function of the quantizing variable Qp and is 
different based on the position of pixel. Therefore, with consideration of 
the position of each pixel in the function ®{Qp) y 0(QP) may be expressed 
as K L Qi> 2 with respect to a u and $(Qp) is expressed as K R Qp 2 with 
respect to a R , and 0(QP) is expressed asK a Qp 2 , with respect to a Uy and 
<b(Qp) is expressed as K D Qp 2 with respect to a D . Here, constants Kl, Kr, 
Ku, Kd are weight values and are different based on whether the 
neighboring pixel is positioned at the block boundary or in the interior of 
the block. With consideration to the position of each pixel, type 
regularization parameter variable is approximated based on the following 
Equation 26. 
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KyQp 



(26) 



K D Q 2 



p 



a ° iMiiJ) - Mii+U)l 2 + K D Q\ 
Assuming that one block is formed of 8x8 number of pixels, namely, 
assuming that I and j of f(ij) is 8, respectively, the weight values Kl, 
Kr, Ku, Kd may be expressed as follows. 
Kl = {9, if j mod 8 = 0; 1, otherwise } 
Kr = {9, if j mod 8 = 7; 1, otherwise } 
Ku = (9, if i mod 8 = 0; 1, otherwise } 
Kd = {9, if i mod 8 = 7; 1, otherwise } 

For example, in the Equation related to Kl, if the residual is 0 when 
dividing j by 8, Kl is 9, and otherwise, Kl is 1. 

When the approximated regularization parameter values are 
substituted for Equation 22, it is possible to obtain a resultant value f(ij). 

Figure 5 is a flow chart illustrating a method for recovering a 
compressed image for an image processing system according to another 
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embodiment of the present invention. 

In Step ST10, it is judged whether the pixels of the current macro 
block are the same as the pixels of the previously transmitted macro 
block based on the COD value. If same, in Step ST11, the recovering 
pixel values are substituted for the pixel values which are previously 
recovered based on Equation 23. If not same, in Step ST12, the 
regularization parameter variables au #u are obtained based on 
Equation 26, and the recovering pixel f(ij) is obtained based on Equation 
22 in Step ST13. 

As described above, in the present invention, a certain weight is 
provided to the regularization parameter variable, which will be 
approximated, based on the position of the pixels in consideration with 
the reliability and smoothing degree as well as the regularization 
parameter variables, so that it is possible to obtain a value which is near 
the actual pixel value. Therefore, in the present invention, it is not 
needed to perform a projection method and a repetition method. In 
addition, in the present invention, the computation amount and time are 
significantly decreased. 
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WHAT IS CLAIMED IS- 

1. A method for recovering a compressed motion picture, 
comprising the steps of: 

defining a cost function having a smoothing degree of an image and 
a reliability with respect to an original image in consideration of the 
directional characteristics of the pixels which will be recovered and a 
plurality of pixels near the recovering pixels; 

obtaining a regularization parameter variable having a weight value 
of a reliability with respect to an original image based on the cost 
function; and 

approximating the regularization parameter variable using the 
compressed pixel and obtaining a recovering pixel. 

2. The method of claim 1, wherein said cost function includes 
another cost function for setting an interrelationship of a time region with 
respect to the recovering pixel when the pixel which will be recovered is 
in an inter macro block. 

3. The method of claim 1, wherein said cost function includes 
another cost function which is defined based on a smoothing degree 
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which is obtained by computing a< difference between the recovering pixel 
and the neighboring pixel, a reliability of the original image obtained by 
computing a difference between the original image and the compressed 
image, and an interrelationship of a time region of the pixels of the block 
having a motion information. 

4 The method of claim 1, wherein said plurality of 

neighboring pixels are the pixels which are neighboring in the upper, 
lower, left and right side directions of the recovering pixels. 

5. The method of claim 1, wherein said regularization 
parameter variable is a weight value with respect to reliability and is 
determined based on a difference between the original pixel and the 
compressed pixel and a difference value between the original pixel and 
the neighboring pixel. 

6. The method of claim 5, wherein said difference value 
between the original pixel and the compressed pixel is approximated 
based on a quantizing maximum difference, and a difference value 
between the original pixel and the neighboring pixel is approximated 
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based on a difference value between the compressed pixel and the 
neighboring compressed pixel. 

7. The method of claim 1, after the step for obtaining a 
recovering pixel, further comprising a step for performing a DCT with 
respect to the recovering pixels, projecting the recovering pixels in 
accordance with pixel value which will be processed and performing a 
reverse DCT with respect to the projected images, and in said projecting 
step, a recovering image is projected at a subset for setting a range of 
DCT coefficients of a compressed image, and a maximum quantizing 
difference of the macro block is included in the subset. 

8. The method of claim 1, wherein in said step for 
approximating the regularization parameter variable, a quantizing 
maximum difference of the macro block unit is a quantizing variable, a 
quantizing difference is uniformly allocated to each pixel in a 
corresponding macro block, and the non-uniform values between two 
pixels of the original image are statistically similar to the non-uniform 
values between two pixels of the original image, 
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9. , The method or claim 1, wherein said regularization 
parameter variable includes a weight value of a smoothing degree of the 
original image based on the cost function. 

10. The method of claim 9, wherein when the pixels of the 
current macro block are the same as the pixels of the previously- 
transmitted macro block, the recovered pixel values are substituted for 
the current pixel values with respect to the macro block of the previous 
image. 

11. The method of claim 9, wherein in said step for 
approximating the regularization parameter variable, a quantizing 
difference of each pixel is set based on a function of a quantizing 
variable set by the unit of the macro block, and weight value is added to 
the pixel based on the position. 

12. In a method for recovering a compressed motion image for 
processing an original pixel f(ij) based on a DCT by the unit of macro 
blocks of a MxM size, quantizing the DCT-processed coefficient, 
transmitting together with the motion vector information, reversely 
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quantizing and reversely PCT-processing the compressed pixel g(ij) and 
recovering an image similar to the original image, a method for 
recovering a compressed motion picture, comprising the steps of: 

defining a cost function M(ij) having a smoothing degree of an 
image and a reliability with respect to an original image as a pixel unit 
in consideration with a directional characteristic between the recovering 
pixels and the pixels neighboring with the recovering pixels; 

adaptively searching a regularization parameter variable a having a 
weight of a reliability with respect to the original image from the cost 
function M(ij); and 

obtaining a projected pixel P(F(u,v)) using a projection method for 
mapping the recovering pixels in accordance with the range value of the 
pixels which will be recovered. 

13. The method of claim 12, wherein said cost function M(ij) 

is formed of a cost function MfiL(f(i,j)) which represents a smoothing 
degree and a reliability with respect to an original pixel f(ij) and a left 
side neighboring pixel f(i,j-l), a cost function MHR(f(i,j)) which represents 
a smoothing degree and a reliability with respect to the original pixel 
f(ij)and a right side neighboring pixel f(i,j + l), a cost function MvT(f(ij)) 
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which represents a smoothing degree and a reliability with respect to the 
original pixel f(ij) and an upper side neighboring pixel f(i-l,j), a cost 
function Mvo(f(ij)) which represents a smoothing degree and a reliability 
with respect to the original pixel f(ij) and a lower side neighboring pixel 
f(i+lj), and a cost function Mx(f(iJ)) for setting an interrelationship of a 
time region with respect to the original pixel. 

14. The method of claim 13, wherein each cost function is 
obtained like the following equations: 

MHL(fGj)) = [ f(ij) " f(ij-D f + & hl [ gGj)-f(ij) f 

MHR(fGj)) = t fGj) ~ fG,M) f + & hr [ g(ij)-f(ij) f 

Mvr(fttj)) = [ f(i,j) ~ f(i-lj) I 2 + avrl gOj)-f(ij) f 

MvnCfGj)) = [ f(ij) " f(i+lj> f + ^vd [ gGj)-f(ij) f 

Mr(f(ij)) = [ f(i,j) - fMc(ij) f + arl gGj)-f(ij) f 

where fMc(ij) represents a motion compensated pixel, <zhl, am. ,#vt, 

a yd and ar represent a regularization parameter variable with respect 

to each cost function. 

15. The method of claim 14, wherein the pixels f(i,j) which will 
be recovered is obtained based on the following equation when the pixel 
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is included in the inter macro block, - 

AiJ-l) + AJJ+D + Ai-U) + Ai+U) + fucUJ) + arorgUj) 



AiJ) = 



5 + Ct TOT 

where, a tot = &hl + &hr+ &vt + &vd + &t, and 

the pixels f(ij) which will be recovered is obtained based on the 

following equation when the pixel is included in the intra macro block, 

. _ AiJ- I) + AiJ+D + Ai-U) + At+U) + a T QTS(iJ) 
AU3) 4 + a T0T 

where a T oT = &hl + a HR + a VT + & VD . 



16. The method of claim 14, wherein said regularization 

parameter variables a hl, a hr , ot vt , # vd , a t are obtained by 
approximations as follows : 

a _ r*a/)-^--u)i 2 a _ \fAU)-a(i+\.m 2 



where Q P i represents a quantizing variable of the /-th macro block. 
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17. The method of claim 12, wherein in said step for obtaining 
the projected pixels P(F(u,v)), when (u,v)-th value F(u,v) of 
two-dimensional DCT coefficient of the original image is smaller than 
G(u,v)-Qp/, the projected pixel P(F(u,v)) is mapped to G(u,v) - Qpl, 
and when the value F(u,v) is larger than G(u,v)+<2p/, the projected pixel 
P(F(u,v)) is mapped to G(u,v) + Qpl, otherwise, the projected pixel 
P(F(u,v)) is mapped to F(u,v), where G(u,v) represents (u,v)th value of 
the two- dimensional DCT coefficient of the compression image, and Qpl 
represents a quantizing maximum difference of the hth macro block 

18. The method of claim 12, wherein the following step is repeatedly 
performed by k-times, which step includes the steps of: 

defining a cost function M(ij) having a smoothing degree of an 
image and a reliability with respect to the original image by the unit of 
pixels in consideration with a directional characteristic between the pixels 
which will be recovered and the pixels neighboring the pixels which will 
be recovered; 

adaptively searching a regularization parameter variable a having a 
weight value of a reliability with respect to the original image from the 
cost function M(i,j); and 
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obtaining a projected pixel P(F(u,v) using a projection method for 
mapping the recovering pixel in accordance with a range value of the 
pixel which will be recovered, for thereby finally obtaining a recovering 
image. 

19. In a method for recovering a compressed motion image for 

processing an original pixel f(i,j) based on a DCT by the unit of macro 
blocks of a MxM size, quantizing the DCT-processed coefficient, 
transmitting together with the motion vector information, reversely 
quantizing and reversely PCT-processing the compressed pixel g(i,j) and 
recovering an image similar to the original image, a method for 
recovering a compressed motion picture, comprising the steps of: 

defining a cost function M(i,j) having a smoothing degree of an 
image and a reliability with respect to an original image as a pixel unit 
in consideration with a directional characteristic between the recovering 
pixels and the pixels neighboring with the recovering pixels; 

adaptively searching a regularization parameter variable a having a 
weight of a reliability with respect to the original image from the cost 
function M(i,j); and 

obtaining a finally recovered image of a spacious region by obtaining 
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a block DCT< coefficient based on a block DCT and. obtaining a projected 
pixel P(F(u,v)) by a projection method for mapping the recovering pixels 
in a range value of the pixel for processing the block DCT coefficient, 
and performing a reverse DCT . 

20. A method for recovering a compressed motion picture 

which is implemented by^ 

an image decoding unit for outputting an information with respect to 
a recovering image such as a decoded image, a qnautized variable, a 
macro block type, and a motion type by decoding a coded image signal; 
and 

a block process eliminating filter for defining a cost function based 
on a smoothing degree of an image and a reliability with respect to an 
original pixel in consideration with a directional characteristic between the 
neighboring pixel and the pixel which will be processed based on the 
pixels which will be recovered using an information with respect to the 
recovering image inputted from the image decoding unit, adaptively 
searching a regularization parameter variable which provides a weight of 
a reliability with respect to the original image for each cost function, and 
recovering an original pixel using a projection method for mapping the 
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recovering pixels in accordance with a range value of the pixels which 
will be processed. 

21. The method of claim 20, further comprising: 

a DCT unit for performing a DCT with respect to an image 
recovered by a block process eliminating filter; 

a vector projection unit for projecting a recovering pixel in 
accordance with a pixel value after the DCT process is performed; and 

an IDCT unit for performing a reverse DCT with respect to the 
image projected by the vector projection unit. 

22. In a method for recovering a compressed motion image for 
processing an original pixel f(ij) based on a DCT by the unit of macro 
blocks of a MxM size, quantizing the DCT-processed coefficient, 
transmitting together with the motion vector information, reversely 
quantizing and reversely PCT-processing the compressed pixel g(i,j) and 
recovering an image similar to the original image, a method for 
recovering a compressed motion picture, comprising the steps of: 

defining a cost function M(i,j) having a smoothing degree of an 
image and a reliability with respect to an original image as a pixel unit 
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in consideration with a directional characteristic between the recovering 
pixels and the pixels neighboring with the recovering pixels; and 

adaptively searching a regularization parameter variable a having a 
weight of a reliability with respect to the original image from the cost 
function M(ij) and a weight value of a smoothing degree of the original 
image. 

23. The method of claim 22, wherein said cost function is 

obtained based on the following equations^ 



M L (f(i,j)) = 


or L (f(ij))[f(ij) 


- f(i,j-l)] 2 


+ 


(l-a L (f(i,j)))[g(i,j)-f(i,j)] 2 


M R (i(i,j)) = 


a R (f(i,j))[f(i,j) 


- f(i,M)] 2 


+ 


(l-ffR(f(i,j)))[g(U)-f(ij)] 2 


Mu(f(i,j)) = 


tfu(f(i,j))[f(i,j) 


- f(i-lj)] 2 


+ 


(l-au(f(i,j)))[g(ij)-f(ij)] 2 


M D (f(i,j)) = 


ffD(f(i,j))[f(i,j) 


- f(i+l,j)] 2 


+ 


(l-«D(f(i,j)))[g(ij)-f(ij)] 2 


where a l, 


an, a u , a d 


are regularization parameter variables with 



respect to each cost function. 

24. The method of claim 23, wherein when the pixel of the 

current macro block is the same as the pixel of the previously 
transmitted macro block, in said pixel f(ij) which will be recovered, the 
pixel value which is previously recovered with respect to the macro block 
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of the previous image is substituted for the current pixel value, and 
otherwise the following Equation is obtained: 

a . aiA i, J" 1) + asKi, J+D + aufo-l,J> + apKi+ U) + (4 -aroMh j) 
At, n = 4 

where a TOT = a L 4- a R + a v 4- a D . 



25. The method of claim 23, wherein said regularization 

parameter variables ctu <*r, #u ,#d are approximated as follows: 



K L Qp 


[«<»./) 


- g{i,j-V)f 


+ 












[«(*,/) 




+ 






KijQp 








- gCt-hm 2 


+ 














- iK*+U)] 2 


+ 





where K L Qp 2 , K R Qp 2 , K V QP 2 , K D Qp 2 are functions of the quantizing 

variable Qp, and constants Kl, Kr, Ku, Kd are weight values with respect 
to the regularization parameter variables a l, a r, a u , a d, and have 
different values based on whether the neighboring pixel is positioned at 
the block boundary or in the interior of the block. 
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- 2o. The method of claim 25, wherein the weight valuta Kl, Kr, 

Ku, Kd are expressed as follows, assuming that i and j of the pixel f(i,j) 
are 8, respectively, 

Kl = {9, if j mod 8 = 0; 1, otherwise } 

Kr = {9, if j mod 8 = 7; 1, otherwise } 

Ku = {9, if i mod 8 = 0; 1, otherwise } 

Kd = (9, if i mod 8 = 7; 1, otherwise } 

27. A method for recovering a compressed motion picture 

which is implemented by: 

an image decoding unit for outputting an information with respect to 
a recovering image such as a decoded image, a qnautized variable, a 
macro block type, and a motion type by decoding a coded image signal; 
and 

a block process eliminating filter for defining a cost function based 
on a smoothing degree of an image and a reliability with respect to an 
original pixel in consideration with a directional characteristic between the 
neighboring pixel and the pixel which will be processed based on trhe 
pixels which will be recovered using an information with respect to the 
recovering image inputted from the image decoding unit, and adaptively 
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searching a r^gularization parameter variable which has a weight of a 

reliability with respect to the original image from each cost function and 

a weight of a smoothing degree of the original image for thereby 
recovering an original pixel. 
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ABSTRACT OF THE DISCLOSURE - ■ 

The present invention relates to a method for recovering a 
compressed image for an image processing technique and an apparatus 
therefor. In the present invention, a cost function is defined in 
consideration with a directional characteristic of the pixels which will be 
recovered and a plurality of pixels of the recovering pixels. In addition, a 
regularization parameter variable having a certain weight is obtained from 
the cost function, and the regularization parameter variable is 
approximated using the compressed pixel for thereby obtaining a 
recovering pixel. The regularization parameter variable has a weight of a 
reliability with respect to the original image and a weight of a smoothing 
degree of the original image. 
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